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MetaArchive Cooperative (2004-) MataYArchve 


Founded as part of NDIIPP funding and activities in 2004 

Educopia Institute founded to serve as administrative home for MetaArchive in 2006 
Currently 14 member institutions in USA, Spain, and Brazil. 

Approximately 12 TB of unique data geographically distributed across 3 continents. 


MetaArchive is a cooperative, not a vendor: 
© All hardware and software assets are owned by members 


© Membership fees and storage fees go to a central pool of support for network operations and members’ co-op 
activities 


Governed by and for members 
© Voting representatives from all member organizations determine policies, membership costs, and network operations 


Membership Levels: Institutional: $4,000/year ; Collaborative: $4,000/year + $100 per institution; 
Storage fee: $0.50/GB/year 


O Technology Rewards: If hosting a LOCKSS cache, 10% of contributed storage volume free 


Cooperative of Volunteers 


e Unlike some LOCKSS networks, we 
have no major university to centrally 
contribute to/manage the network. 

e Salaries for community managers and 
technical contractors come from 
membership fees. 

e Value: Promote a cooperative, robust, 
and decentralized approach to digital 
preservation 

e Nineteen years and running! 
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Cooperative Digital Preservation 
Documentation 
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What led up to the 
Documentation Working Group? 


e Trust had eroded in the 


documentation due to several factors: 
o 15+ years of unchecked organic growth 
o Member confusion about where to find info 
o Most documentation kept behind logins 


e Working Group Charge: updating 
documentation, and a plan for ongoing 
maintenance 

e ~/60 pages across two wikis, ~1,500 
Google Drive files, website, and 
server-side technical documentation 
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Journey Mapping Visual: “Three Big Buckets” 


Prospective 


Members 


New Institution Members 


New MA Members 


Server Admins 


Data Wranglers 
(making AUs) 


Supervisors (of folks 
working on MA stuff) 


Committee Members 
MA Tech Staff 


MA Admin Staff 


Decision Makers / Library” 
Admins (budget, etc.) 
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General, public 
information 


occasionally 


Detailed, sometimes 
technical 
documentation, 


Changes sometimes 
Changes 


- Committee Landing 
Pages 
- New Member 
onboarding page/ 


Process documentation 
(meeting minutes, 
working documents for 
committees, surveys and 
results, elections, 
agreements and invoices, 
etc.) 


Stuff that gets made/ 
created once, then rarely 
changed/edited 


Some living documents 
(presentation slides, 


working documents, etc.) 


*put password/IP lists 
here to ease sharing? 
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The Low-Hanging Fruit 


e Migrate meeting minutes from wikis to 
Google Docs 
e Review Q&A Sessions in AirTable to 


identify immediate information needs 
o Crosslink from Confluence to AirTable and 
vice-versa, closing the information loop. 


e Review “Orientation to MetaArchive” 
lesson plans to identify information needs 
that will impact prospective and incoming 
members. 
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The High-Hanging Fruit: 
Technical Documentation 


e Unlike the Website or Google Docs, the 
technical documentation required both 
technical knowledge and experience (or 
access to people who have it), as well 
as time to disentangle, update, and 
refine the documentation that exists. 

e Blurry lines between MA tools and 
LOCKSS, so documenting both 

e Slower work, harder to organize, and 
harder on morale 

e Requires a willingness to be “in the 
thick of it” 
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How did we make It sustainable 
and future-proof? 


e Revise the Charter to make the 
Documentation Working Group a 
permanent Committee 

e Make information flow a design feature 

e Pair documentation 
Make documentation as freely available 
as (securely) possible 

e Take advantage of “working hours” 
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[DRAFT] Revised Charter 


3.2.45. MetaArchive Documentation Committee 


The Documentation Committee is responsible for developing and 
maintaining documentation to support the governance, outreach, and 
technical activities of the MetaArchive Cooperative. Documentation 
Committee members will liaise with MetaArchive committees and working 
groups to ensure that governance and outreach activities are 
documented; members will also liaise with the Technical Committee, 
Technical Team, and external technical working groups as appropriate to 


ensure that technical documentation is kept up-to-date. 
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Make Information Flow a (Committee) Design Feature 


Information Flow Documentation 
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Config file backups 
Created by Cliff Landis, last modified on Apr 26, 2023 
e 1 Overview 
© 2 Shell Scripts 
2.1 weekly_backup.sh 
2.2 validate_zipsh 
2.3 mv2longsh 
¢ 3 Setting up a new cache’s backup 


Overview 


This page documents the server scripts that copy the config backups from individual member's 
caches to the central data2 server. 


¢ weekly_bkup.sh 
¢ validate_zip.sh 
¢ mv2long.sh 


Shell Scripts 
weekly_backup.sh 


The shell script weekly_bkup.sh completes the weekly backup action. 


Within /home/metaarchive/cache_bkup/storage, there is a directory for each institution's 
ache {j ated here using cmu as an example): 


Pair Pregraramiag Documentation 


Identify a technical documentation need, 
and the appropriate technical staff 
member 

Schedule a Zoom ride-along with 
technical staff 

Take screenshots of the technical staff 
members’ screen, to capture 
server-based tools that | don’t have 
access to 

Write up documentation, then ask for 
review by the technical staff member 
Verbal walk-through saves staff time, and 
allows me to write documentation for the 


appropriate audience 
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Make Documentation as Freely 
Available as (Securely) Possible 


e Freely Available: 
o How MetaArchive Works 
o Technical Workflows 
o Knowledge Base (Glossary, Context, Best 
Practices) 


e Keep user groups simple, based on 


role: 
o Most documentation publicly visible 
o Restricted areas for Technical Team 
(developers) and Network Administrators (IT 
at member institutions) 
e Migrated-but-not-yet-reviewed content 
available to Tech Team and Network 
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Take advantage of “working hours” 


e To keep the ball rolling, we set aside dedicated 
co-working time, where we can work quietly 
together and ask questions as they come up 

e lt started with Documentation Working Group 
Working Hours on Fridays 3:00-4:00pm (rote 
work when you're already brain-fried) 

e The Technical Team now has 10 minutes for a 
quick documentation review before the main 
content of the meeting begins 

e The Technical Committee now stays on for 30 
minutes after the main meeting to work on 
action items from the meeting. 
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Observations & Future Explorations 
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Common Themes of 
Documentation & Digital 
Preservation 


e Everyone agrees it’s important, and 
no one wants to do it 

e Treated as an afterthought 

e Often the first thing to be cut when 
resources run out 

e Requires regular maintenance work 
to ensure it is serving its purpose 

e People turnover can bring things to 
a screeching halt 

e Something is (almost) always better 
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Common Themes of 
Documenters & Preservationists 


e Writing love letters to the future 
o 6“ have this frenemy called ‘Past Matt” 

e Ready to move mountains, one 
spoonful at a time 
Risk-averse, long-term thinkers 
View setbacks as opportunities to learn 
and improve workflows 

e Operate in the liminal space between 
people and computers 
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“We can think of labour that goes into maintenance 
and repair as the work of the maintainers, those 
individuals whose work keeps ordinary existence going 
rather than introducing novel things. Brief reflection 
demonstrates that the vast majority of human labour, 
from laundry and trash removal to janitorial work and 
food preparation, is of this type: upkeep.” 


Russell, A. & Vinsel, L. (7 April 2016) Hail the maintainers. Aeon. 
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Potential Next Steps 


e Partner with LOCKSS to develop LOCKSS documentation that dovetails with 
MetaArchive documentation (reducing duplicative and out-of-sync documentation) 

e Consolidating all code and scripts into a Git workflow (currently used for some but 
not all server-side coding) 

e Exploring additional tools: 

o Oxford Common File Layout - https://ocfl.io/. A specification that describes an 
application-independent approach to the storage of digital information in a 
structured, transparent, and predictable manner. It is designed to promote 
long-term object management best practices within digital repositories. 

o Architecture Decision Records - 
https://github.com/joelparkerhenderson/architecture-decision-record. An 
architecture decision record (ADR) is a document that captures an important 
architecture decision made along with its context and consequences. 

e Dreaming Big! Adding a dedicated Technical Writer position 
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Questions? 


Contact MetaArchive: 


Hannah Wang 
MetaArchive Community Facilitator 
hannah.wang@educopia.or 


Connect with us: 


metaarchive.org/ 
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